Papers with scalability issue
TADA : Task Agnostic Dialect Adapters for English (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work on dialectal English NLP is task-specific, using manual annotated dialect data, weak supervision, or data augmentation. |
| Approach: | They propose a method for task-agnostic dialect adaptation by aligning non-SAE dialects with task-specific adapters from SAE. |
| Outcome: | The proposed method improves dialectal robustness on 4 dialectal variants of the GLUE benchmark without task-specific supervision. |
Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention (P19-1)
Copied to clipboard
| Challenge: | Existing models for limited-domain RNNs are difficult to scale due to the complexity of the inputs. |
| Approach: | They propose to use dialog acts to build a multi-layer hierarchical graph with a disentangled self-attention network. |
| Outcome: | The proposed model improves on the baselines on automatic and human evaluation metrics. |
Scaling up Open Tagging from Tens to Thousands: Comprehension Empowered Attribute Value Extraction from Product Title (P19-1)
Copied to clipboard
| Challenge: | Existing models treat each attribute as an entity type and build one set of NER tags for each of them, leading to scalability issues. |
| Approach: | They propose to regard attribute as a query and adopt only one global set of BIO tags for any attributes to reduce the burden of attribute tag or model explosion. |
| Outcome: | The proposed model outperforms state-of-the-art models and generates promising results for 8,906 attributes. |
UniKER: A Unified Framework for Combining Embedding and Definite Horn Rule Reasoning for Knowledge Graph Inference (2021.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge graph inference has been studied extensively due to its wide applications. |
| Approach: | They propose a framework that restricts logical rules to be definite Horn rules and can exploit the knowledge in logical rule-based reasoning and KGE in an extremely efficient way. |
| Outcome: | The proposed framework can exploit the knowledge in logical rules and improve KGE in an extremely efficient way. |